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Abstract 



In our previous paper [ ], we studied the condition metric in the 
space of non-singular n x ni matrices. Here, we show that this con- 
dition metric induces a Lipschitz-Riemann structure on the space of 
all n X m matrices. After investigating geodesies in such a nonsmooth 
structure, we show that the inverse of the smallest singular value of a 
matrix is a log-convex function along geodesies (Theorem 1). 
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We also show that a similar result holds for the solution variety of 
linear systems (Theorem 31). 

Some of our intermediate results, such as Theorem 12, on the sec- 
ond covariant derivative or Hessian of a function with symmetries on 
a manifold, and Theorem 29 on piecewise self-convex functions, are of 
independent interest. 

Those results were motivated by our investigations on the com- 
plexity of path- following algorithms for solving polynomial systems. 



1 Introduction 

Let two integers 1 < n < m be given and let us consider the space of matrices 
j^nxm^ K = M or C, equipped with the Frobenius inner product 

{M,N)p = trace {N*M) = ^mijn^. 

id 

We denote by 

ai(A)>...>a„_i(A)>a„(A)>0 

the singular values of a matrix A G K"^"*, by Ghn,m the space of matrices 
A G K"^™ with maximal rank, that is rank A = n or, equivalently, 0"„(y4) > 
0, and by JV the set of singular (or rank deficient) matrices: 

AT = K"^" \ GL„,„ = {Ae K"^"^ : (T„(A) = O} . 

The distance of a matrix A G K"^™ from J\f is given by its smallest singular 
value: 

dF{A,M) = min \\A - S\\p = cr„(A). 

Consider now the problem of connecting two matrices with the shortest 
possible path staying, as much as possible, away from the set of singular 
matrices. We realize this objective by considering an absolutely continuous 
path A{t), a < t < b, with given endpoints (say A{a) = A and A{b) = B) 
which minimizes its condition length defined by 

a.^{A{t))-Ht. 

F 

We call minimizing condition path an absolutely continuous path which 
minimizes this integral in the set of absolutely continuous paths with the same 
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end-points. We define a minimizing condition geodesic as a minimizing 

condition path parametrized by the condition arc length, that is when 



dA{t) 



dt 



(XniAit))-' = 1 a. e. 

F 



A condition geodesic is an absolutely continuous path which is locally a 
minimizing condition geodesic. This concept of geodesic is related to the 
Riemannian structure defined on GL„ ,„ by: 

(M,iV)^_^ = a„(A)-2Re(M,iV)^. 

We call it the condition Riemann structure on GL 



Our objective is to investigate the properties of the smallest singular value 
(7„,(A(t)) along a condition geodesic. Our main result says: 

Theorem 1. For any condition geodesic t — )■ A(t) in Ghn^m, the map t — )■ 
log (cT~^(A(t))) is convex. 

This theorem extends our main result in [ ]. In that paper, the same 
theorem is proven for those condition geodesic arcs contained in the open 
subset 

GL>^ = {Ae GL„,„ : an-i{A) > a„(v4)} 

that is when the smallest singular value (Tn{A) is simple. The reason for this 
restriction is easy to explain. The smallest singular value crn{A) is smooth in 
GL^^, and, in that case, we can use the toolbox of Riemannian geometry. 
But it is only locally Lipschitz in Ghn^m] for this reason we call the condition 
structure in GL„ ^ a Lipschitz-Riemannian structure. 

Motivation: Let us now say a word about our motivations. The (today) 
classical papers [21], [25], and [2l>] by Shub and Smale relate complexity 
bounds for homotopy methods to solve Bezout's Theorem to the condition 
number of the encountered problems along the considered homotopy path. 
Ill-conditioned problems slow the algorithm and increase its complexity. For 
this reason it is natural to consider paths which avoid ill-posed problems, 
and, at the same time, are as short as possible. The condition metric has 
been designed to construct such paths. It has been introduced by Shub 
in [23], then studied by Beltran and Shub in [ ] in spaces of polynomial 
equations. The case of linear maps (and related spaces) appears in Beltran- 
Dedieu-Malajovich-Shub [ l] and Boito-Dedieu [ti]. 
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The main result relating condition metric and complexity appears in 
[11] (see also [2] and [19]): there is an algorithm that, given a continuous 
path (/t)te[o,i] in the space of systems of homogeneous polynomial equations, 
computes a mesh = to < ti < ■ ■ ■ < t^. = 1 and approximate zeros (in 
the sense of Smale) Xi associated to (a, where ft{Ct) = 0. This algorithm 
terminates in time linear in 

where D is the maximum degree of the equations, e is an arbitrary parameter 
and L{ft, (t) is the condition length of the path {ft, (t)- 

In the linear case, it is rather a remarkable fact that the inverse of the 
squared distance to singular matrices a~'^{A(t)) is log-convex along the con- 
dition geodesies. So, in particular, the maximum of log (cr„(A(t))^^) along 
such paths is necessarily obtained at its endpoints and the condition geodesies 
stay away from singular matrices. 

In our last theorem (Theorem 31) we prove a version of our main result 
in the context of the solution variety 

W = {{A,x)e Ghn,n+i X P(K'^) ■.Ax = 0} . 

Above, the notation P(E) denotes the projectivization of a linear space E. 
Namely, it is the space (manifold) of real or complex lines in E passing 
through the origin. For instance, P(M^) is the classical projective plane, that 
can also be obtained by identifying antipodal points of the sphere S"^. We 
think this property may help to find good preconditionners to solve linear 
systems which would be a good area for future research. 

We don't know if the analogue of Theorem 31 holds in the solution variety 
corresponding to the space of polynomial systems, although Proposition 10 
proves it for systems which vanish at a given point. If self-convexity of the 
condition number where to hold into the condition variety itself we would 
have a good geometric picture of what is involved in choosing a homotopy 
path in an optimal (or near optimal) way. 

Outline of the paper 

The condition number is not of class C^, hence we cannot apply the usual 
Riemannian geometry to the condition metric. In Section 2, we introduce 
Lipschitz- Riemann structures and develop the basic results, that allow us to 
do differential geometry in the non-smooth case. Using nonsmooth analysis 
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techniques, we prove that any condition geodesic is with a locally Lipschitz 
derivative (Theorem 3). Such techniques are already present in Boito-Dedieu 
[6]. 

In Section 3 we develop an important tool for proving self-convexity, al- 
lowing a more systematic use of the symmetries. (A symmetry is an isometry 
of a manifold that leaves a function invariant). Theorem 12 gives a simplified 
computation of the Hessian when there is a Lie group of symmetries. This 
theorem may be of independent interest. It is so natural we would not be 
surprised if it is already known, but we have not found it anywhere. We 
were led to this theorem sometime after a conversation with John Lott on 
Hessians and Riemannian submersions while he was visiting the University 
of Toronto. 

The strategy for proving the main theorem is to decompose the space of 
matrices in a finite union of smooth manifolds, so that in each of them the 
metric is smooth. In Section 4 we produce this decomposition, we study the 
group of symmetries of the condition number and then, using Theorem 12, 
we establish self-convexity on each piece. 

In Section 5, we prove a result that may be of independent interest. The- 
orem 29: piecing together convexity results on restrictions of the Lipschitz- 
Riemann structure to a union of submanifolds of varying dimensions, where 
the structure is smooth, to obtain a global result. 

In Section 6, we use all these tools to finish the proof of Theorem 1. 
We use the same tools in Section 7 to state and prove Theorem 31 about 
self-convexity in the solution variety. 

Acknowledgements. We have benefited greatly from conversations with 
our colleagues Charles Pugh and Vitaly Kapovitch about Lipschitz-Riemann 
structures, especially those conformally equivalent to smooth structures by 
locally Lipschitz scaling maps. 

Some of this work was accomplished when we met not only in our intitu- 
tions, but also at the Institut de Matematica de la Universitat de Barcelona 
and at the Thematic Program in the Foundations of Computational Math- 
ematics (FoCM) at the Fields Institute. We thank these institutions. Also, 
we would like to thank an anonymous referee. 
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2 Geodesies in Lipschitz-Riemann structures, 
and self-convexity 



2.1 Lipschitz-Riemann structures 

Most textbooks of Riemannian geometry define a Riemannian structure on 
a smooth manifold as a scalar product (•, ■)x on each tangent space T^M., 
depending smoothly on x. Here we drop the smoothness hypothesis. 

Definition 2. A Lipschitz-Riemann structure on a manifold is 
a scalar product at each Tj,A^, such that its coefficients are locally 

Lipschitz functions of x. Also, let ||M||a; = (m, u)x be the associated norm 



The length of an absolutely continuous path G A^, a < t < 6, is 
defined as the integral 



where x{t) denotes the derivative with respect to t. Its eirc length is given 
by the map 



The distance d{a^ h) between two points a, 6 G is the infimum of all the 
lengths of the paths containing a and h in their image. We call minimizing 
path an absolutely continuous path such that L{x,a,b) = d{a,b). 

It is usual in differential geometry textbooks to construct geodesies as 
solutions of a certain second order differential equation, the geodesic differ- 
ential equation. Unfortunately, the coefficients of this equation are given by 
a formula in terms of the partial derivatives of the metric coefficients. In a 
Lipschitz-Riemann structure, those coefficients are assumed to be Lipschitz, 
not necessarily differentiable functions. Also, it turns out that minimizing 
paths are not necessarily smooth. 

We define a minimizing geodesic as a minimizing path parametrized 
by arc length, that is when 



A path in A4 parametrized by arc length is a geodesic when it is locally a 
minimizing geodesic. 

The main result of this section is the following: 



in T^M. 




t G [a, b] — )■ L{x, a, t) G [0, L{x, a, b)]. 



*WL(t) = 1 a. e. 
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Theorem 3. Any geodesic for a Lipschitz-Riemann structure belongs to the 
class C^+^^p that is with a locally Lipschitz derivative. 

This theorem is proved in sections 2.4 and 2.4, it extends a similar resuh 
by Charles Pugh [21] who proves the existence of locally minimizing (7^+^*p 
geodesies. His argument is based on a smooth approximation of the Lips- 
chitz structure where the classical toolbox of Riemannian geometry applies, 
followed by a passage a la limite. 

Using different techniques we prove here this regularity assumption for 
all geodesies. 

An immediate consequence of [/, Cor .VIII-4 p. 126] is that C^+^^p = 
W'^'°° the Sobolev space of maps / with /" e L°°. 

2.2 Existence of geodesies in a Lipschitz-Riemann struc- 
ture 

Existence of minimizing geodesies with given endpoints may be deduced from 
the Hopf-Rinow Theorem. Because we cannot assume the smoothness of 
geodesies, we refer to Gromov's version of this theorem [16, Th.1.10]. A 
metric space {X, d) is a path metric space if the distance between each 
pair of points equals the infimum of the lengths of curves joining the points. 

Theorem 4. // (X, d) is a complete, locally compact path metric space, then 

• Each hounded, closed subset is compact, 

• Each pair of points can he joined hy a minimizing geodesic. 

Two examples of such spaces are given by Boito-Dedieu [( >] for linear maps 
(X is one of the connected components of GL„^m equipped with the condi- 
tion structure), and by Shub [23] when X is the solution variety associated 
with the homogeneous polynomial system solving problem equipped with the 
corresponding condition structure. 

2.3 Lipschitz-Riemann structures in M^, generaUzed gra- 
dients and the problem of Bolza 

An important example of Lipschitz-Riemann structure is given by an open 
set C M'^ equipped with the scalar product 

(m, v)x = v^H{x)u 
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where if is a locally Lipschitz map from Q into the set of positive definite 

n X n matrices. 

A minimizing geodesic x{t) & fl, a < t < b, minimizes the integral 

^y{trH{y{t))y{t)dt 

in the set of absolutely continuous paths y{t) with endpoints y{a) = x{a), 
and y{b) — x{b). This is an instance of the Bolza problem. 

For a smooth integrand L, a local solution x{t) of the Bolza problem 

inf f L{y{t),y{t))dt, (2.1) 

J a 

where the infimum is taken in the set of a.c. paths with given endpoints, 
satisfies the Euler-Lagrange differential equation 



In our context, it is possible to differentiate L(x,x) = ^Jx'^ H{x)x with re- 
spect to the second argument by ordinary differential calculus: 

d 1 
—L{x,x) : y ^ — — -x^H{x)y. 
ox L{x,x) 

If we avoid i; = (which will be the case), we deduce that L is smooth in 
the variable x and locally Lipschitz in the variable x. For this reason we 
replace the classical geodesic differential equation by a generalized version of 
the Euler-Lagrange equation based on generalized gradients. 

Let / : Q C R'^ — > R be a locally Lipschitz function defined on an open 
set. Its one-sided directional derivative at x e Q in the direction d e R'^ 
is defined as 

^ ' ^ t->0+ t 

The generalized directional derivative in Cleirke's sense of / at x e Q 

in the direction d is defined as 

r f{y + td)-f{y) 
J {x,d) = limsup^ — 

y X ^ 
t 0+ 
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and the generalized gradient of / at x is the nonempty compact subset of 
M'^ given by 

df{x) = {seR'' : {s,d) < r{x, d) for all d G M*^} . 

It turns out that the generalized gradient is always a convex set. When / G 
C^iP) the generalized gradient is just the usual one: df{x) = {V/(x)} . The 
generalized directional derivative is related to the gradient via the equality 

f°{x,d) = max {s,d) . 

s&df{x) 

We say that / is regular at x when the two directional derivatives exist and 
are equal: 

d) = f'{x, d) for any d e R\ 

When / is defined on a manifold A4, we say that / is regular at 
m G when its composition with a local chart at m gives a regular map in 
the usual meaning. 

Good references for this topic is Clarke [l.;] or Schirotzek [2:2]. 

For the problem of Bolza described above the counterpart of the Euler- 
Lagrange equation is given by the following result (see [10] Theorem 4.4.3, 
and [9]). 

Theorem 5. Let x solve the Bolza problem (2.1) in the case in which L{x, x) 
is a locally Lipschitz map and suppose that x is essentially bounded. Then 
there is an absolutely continuous map p such that 

pit) G dxL{x(t),x(t)) and pit) G d^L^xit) , x{t)) a.e. 
2.4 Proof of Theorem 3 

Since Theorem 3 is of local nature, it suffices to prove it locally in M'^. Once 
this is done, take a local chart and transfer the Lipschitz-Riemann structure 
of A4 to an open set i7 C M'^ where the theorem is already proved. Therefore, 
let us show the theorem in R^. 

By definition, a geodesic is a locally minimizing geodesic. Thus, it suffices 
to establish the theorem in this case. 

A minimizing geodesic x{t) ^ Q, a < t < b, is parametrized by arc length 
so that 

x{t)'^H{x{t))x{t) = 1 a.e.. 
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Thus, x(t) is 7^ and essentially bounded: 

X e ([a,6],M^) . 
Moreover, x minimizes the integral 

' ^yitrHiy{t))y{t)dt 

in the set of absolutely continuous paths with endpoints y{a) = x{a), and 
y{b) = x{h). Thus, according to Theorem 5, there is an absolutely continuous 
arc p such that 

p{t) e d^^x{tyH{x{t))x{t), (2.2) 
p{t) G d^^x{t)TH{x{t))x{t) (2.3) 

for almost all t G [a,b]. Since our integrand is smooth in the x variable we 
may write (2.3) 

, , H(x(t))x(t) 

p{t) = ^ ^ = H{x{t))x{t). 

^x{tYH{x{t))x{t) 

Thus, x{t) = H{x(t))^^p(t) is absolutely continuous and x{t) possesses a.e. 
a second derivative x(t) G L^{[a,b],M.''). 

We now have to show that this second derivative is essentially bounded. 
This comes from (2.2). Since a/^ is a smooth function we get from Proposition 
2.3.3 and Theorem 2.3.9 of Clarke's book [ ] that 



dx\/x^H{x)x C ^ dH{x)x^ ^ -x^dH(x)x, 
^ ^ ' 2^x^H{x)x 2 ^ ^ ' 



with 



x^dH{x)x = XiXjdh 



Equation (2.2) implies 



p{t) G ^x{t)^dH{x{t))x{t) a.e. 

From the hypothesis, the functions hij{x) are locally Lipschitz. Their gener- 
alized gradients are compact convex sets in R''. The union of all these sets 
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along the path x(t) gives us a bounded set. Since the curve x(t) is continuous, 
we deduce from these considerations, that p{t) is bounded a.e. Thus p{t) is 
Lipschitz, and x{t) = H{x{t))~^p{t) is also Lipschitz. The second derivative 
x{t) is thus bounded by the Lipschitz constant of x{t), and we are done. 

Remark 6. The previous lines give the following properties for a geodesic x 
inn-. X e C^+^'P, x^H{x)x = 1, and 

^{H{x)x) G -x^dH{x)x = -'^^XiXjdhij{x) a.e. 

The initial value problem, and even the boundary value problem associated 
with this second order differential inclusion, may have many solutions. Ex- 
amples are given in [6] . Moreover, solutions are not necessarily locally mini- 
mizing geodesies and geodesies are not necessarily unique. 



2.5 Conformal Lipschitz-Riemann structure 

The example of a Lipschitz-Riemann structure which motivates this paper is 
given by the condition structure on Ghn,m- It is obtained in multiplying the 
Frobenius scalar product by the locally Lipschitz function cr~^. Let us put it 
in a more general setting. 

Definition 7. Let (A^, (-,■)) be a Riemannian manifold, and let a : 
— > M be a locally Lipschitz function with positive values. Let Ai^ be the 
manifold Ai with the new metric 

= a{x){-,-)x 

called condition Riemann structure or simply condition structure. 

We say that a is self-convex when loga(7(t)) is convex for any geodesic 7 
in M^. 

We denote by L (respectively L^) the length of a curve 7 in the Ai- 
structure (respectively in the A^^-structure). We will speak of length or 
condition length, and also of distance or condition distance, geodesies 
or condition geodesies and so on. 

Examples of self-convex maps are given in [1] where this concept is intro- 
duced for the first time. 

Using this definition Theorem 1 above reads 

a{A) = (T„(A)~^ is self-convex in Ghn^m- 
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3 Self-convexity in the smooth case and the 
computation of Hessians 

3.1 Self-convexity in the smooth case 

Self convexity in the smooth case was studied in our previous paper [1] in 
this journal. We refer the reader to Section 2 of [ ] for basic definitions 
regarding convexity and geodesic convexity. A snapshot of the main features 
of self-convexity in the smooth case follows. 

We denote by D the Levi-Civita connection and by DxT the covariant 
derivative of a tensor T in the direction given by a vector field X. Recall 
that if we assume geodesic coordinates in the neighborhood of a point p, 
then [DxT)p is the same as the ordinary directional (or Lie) derivative. The 
covariant derivative is coordinate independent, in the sense that DxT is a 
tensor. 

If / is a function, then its derivative with respect to a vector field is 
denoted by so that X{f){p) = Df{p)X{p) = {V f{p), X{p))p. The 

second covariant derivative of a function / (sometimes also known as the 
Hessian) is defined by 

D'fiX, Y) = D{Df){X, Y) = DxiXU)) - {DxY){f) (3.1) 

where X and Y are smooth vector fields. The operator above is symmetric, 
in the sense that D'^f{X, Y) = D^f{Y, X) (see e.g. [ , p.305]) 

When a : — )■ M is C^, self-convexity of a is equivalent to the second 
covariant derivative of log(a) being positive semi-definite in the a-condition 
Riemann structure (see [2(S] Chap. 3, Theorem 6.2). Note that the second 
covariant derivative of a map — )■ M is different in Ai and in A^^- We 
denote them respectively by or D"^. Self-convexity of a is equivalent to 
D"^ log(a) being positive semi-definite. 

Proposition 2 of [i] is 

Proposition 8. For a function a : Al — t- M o/ class with positive values 
self- convexity is equivalent to 

2a{x)D^a{x){x,x) + ||Da(x)||^||i;||^ - 4:{Da{x)xf > (3.2) 

for any x E Ai and for any vector x G T^Ai, the tangent space at x. 
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3.2 Self-convexity in a product space 

Proposition 2 of [ ] ] has an immediate corollary which can be useful. Suppose 
is another Riemannian manifold. Give Ai x^f the product metric. Let 
IT : M X J\f ^ M he the projection on the first factor and a : M x J\f 
be the composition a = a o n. 

Proposition 9. Let a be of class in M.. Then, a is self-convex in Ad if 
and only if a is self-convex in Ai x M . 

We thank an anonymous referee for pointing out the z/part of this Propo- 
sition and simplifying the proof. 

Proof. We prove first the only if part. Let (x,?/) E Ai x M and assume 
normal (geodesic) coordinates in a neighborhood of x G A^. Also, assume 
normal coordinates around y E Af with respect to the inner product (■, 

We claim that this defines a system of normal coordinates in Aix Af. This 
can be seen from the fact that the exponential map in a product manifold 
A^ X A/" is the partitionning of the exponential mappings of Ai and JV. 
However, we give a direct proof below. 

Let Qij and P^^- denote respectively the coefficients of the first fundamental 
form {■,-)x,y and the Christoffel symbols. By construction, gij{x,y) = 6ij. 
Also, it is easy to see that for all indexes i,j, k, 

Tl^{x,y)=0. 

Indeed, if indices {i,j, k) correspond to the same component A/1 or A/" this 
follows from the choice of normal coordinates in each component. Otherwise, 
say that i, j correspond to coordinates in Ai and k to coordinates in A". Then 
Qik = Qj^. = and furthermore, 

—^g,^{x,y) = ^. 

Thus Tikj{x,y) = for all indexes i,j,k. This implies that T^j{x,y) = as 
well. Thus we have a normal system of coordinates around (x, y) E Ai x M. 

In that system of coordinates, 

D\i^M^{,x,y) = 



D]^a{x) 
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From the block structure of the second covariant derivative above, it is clear 
that Dj^^j^a^XjU) is positive definite if and only if Dj^a{x) is positive 
definite. 

□ 

We have raised the question in the introduction of whether self-convexity 
of the condition number holds for the condition Riemann structure on the 
solution variety considered in [23] . The theorems proven in this paper apply 
to the case of linear systems, but with the use of Proposition 9 they give us 
some information on polynomial systems almost for free. The proof follows 
from Propositions 19, 9 and Theorem 29. 

Let d = (cii, . . . , dn). Consider the vector space 

Vdfl = {(/i, • • • , /n) : /j e C[xi, ...,Xn] with deg fi = di and /j(0) = 0}. 

An important point is that self-convexity is well-defined for Riemannian 
manifolds. Therefore, is we want to speak of self-convexity in Vd,Oi we need 
to make it into an inner product vector space. We will follow [0] and assume 
the unitarily invariant metric in the space of degree di polynomials. This is 
the same as the metric for symmetric dj-tensors. Then we define the product 
metric for Vd and it is inherited by the subspace Vd,o- In more precise terms: 

if -p ■( rr\ — \ ^ f . rr^^ rr^n Q-nrl n ■ { — \ ^ n ■ rr'^^ rr^^ . . . rr^n 

n Ji\X) — l^i<\a\<di J'l-a-^l -^2 -^n '^'■'-^ yiX.-^ J — Z^l<|a|<di i/fi-^l -^2 -^n 

then we set 

fia9ia 



{f,9) 



with 



E E 

i=l l<\a\<di 

di\ 



di _ 

a J ai\a2\ ■ ■ ■ aji^di - \a\)\ 

This vector space splits as Vd,o = jCq Q) (H.O.T.)q where Co are linear and 
(H.O.T.)q are higher order polynomials vanishing at 0. Those two spaces are 
orthogonal. The inner product for linear polynomials is 

n ^ n 

{Ax, Bx) = J2j,Yl ^^i^'i = 
i=i * j=i 





/ 








* 
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The unsealed, normalized condition number is defined, for / e Vd,o, by 













/ 
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M/,o) = 














Df{0) 
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Proposition 10. is self-convex in its domain of definition Vdfi \ where 
E = {f e Vd,o '■ -Df(O) is degenerate}. 



3.3 Computation of the Hessian 

When analyzing the convexity properties of (T„(A), we first note that this 
function is invariant through unitary changes of coordinates, namely 

aniA) = aniUAV*) 

for unitary matrices U E Vn, and V e (resp. orthogonal matrices U e 
0„, and V e Om)- Let us consider this situation in a general framework. 

A Lie group is a group that is also a smooth manifold, and such that 
the group operations (multiplication and inversion) are smooth. We say that 
a Lie group G acts (smoothly) on a manifold A4 if there is a smooth map 
£:GxM^M with 

Ki9i92),p) =%i,-^(^2,p)) and e{l,p) =p . 

In the example above, G = Un x Um acts on GL,n,m by i{{U, V),p) = UpV*. 
For simplicity, we may write g{p) for i{g,p) and assimilate g to the mapping 
p — > g{p) — i{g,p). We say that the Lie group G acts by isometrics when for 
all g, the corresponding map g : p ^ g{p) is an isometry of M.. 

Definition 11. Let a : Al — > R. A group of symmetries of a is a Lie 

group, acting smoothly by isometrics on M., and leaving a invariant (that 
is, a{g{p)) — a{p) for all g & G and p e M.. 

Note that it may happen (for instance, if G is a discrete group) that 
= {0} and hence TpGp = {0}. 

Given p G M, G{p) = {g{p) : g G G} will denote the G-orbit of p. The 
orbit G{p) is a manifold. If the group G is compact, the orbit is an embedded 
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manifold. In any case, TpG{p) will denote the tangent space of the orbit G(j)) 
at p, as a subspace of TpAi. It can also be described as the set of all 



^(exp(ta)(p)) 



i=0 ' 



for a G 0, the Lie algebra of G. 

For instance, when G = U„ x Um, then q is An x Am (the anti-symmetric 
matrices) and exp(ta) is the usual matrix exponential: 



f2 \ / f2 

,2 I \ „ / r I j-„ I „2 



exp(t(ai,a2))(p) = yl + tai + — H j pyl + ta2 + — + ■■ 

Theorem 12. Let 6e a smooth Riemannian manifold. Let a : — )■ M 
6e o/ class C^, and /et G be a group of symmetries of a. Let p & M.. Let 
w = b + k E TpM. where k e TpG{p), b _L TpG{p). Let the vector field K be 
the infinitesimal generator associated with some element a in the Lie Algebra 
Q of G, where k = ^{exp(ta){p)) |j^g. Namely, 

K{q) = ^iexp{ta)q) {^^^ , q E M. 

Let 4>t{q) = 4>(t, q) be the flow o/grad a, defined for t G {—e,e) and q close 
enough to p. Let B be a smooth vector field in Ai such that B{(j)t{p)) = 
D(f)t{p)b where D denotes the usual derivative applied to the diffeormorphism 
0f : — i- . Then, the following equality holds: 

D'^a{p){w, w) = 

D^a{p){b, b) + ^(grad (||irf grad a{p))p + grad K)){p). 

Above, gi&d a{{B , K)){p) = {gra-d a{p),grad {{B, K)p))p is the direc- 
tional derivative of {B,K) with respect to grad a. 

Let us recall from (3.1) the intrinsic definition of the second covariant 
derivative or Hessian. 



D^a{p){v,w) = X{Y{a))p - {DxY){a) 



where X,Y are vector fields, X{p) = v, Y{p) = w, and D is the Levi-Civita 
connection. Also, [X, Y] is the Lie bracket of two vector fields X and Y. 
It is defined for any a of class by 

[X,Y]{a) = X{Y{a))-YiX{a)). 
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It turns out that this is a first order differential operator, hence [X, Y] is a 
vector field. 

Another useful identity relating the Lie bracket and the Levi-Civita con- 
nection is: 

[X,Y] = DxY -DyX (3.3) 
The proof of Theorem 12 is a consequence of the two following lemmas: 

Lemma 13. For any vector field X on M, we have 

2D^a{X,K) =grad a{{X,K)) - ([grad a,X],K). 

Moreover, 

D'a{p){k,k) = ^(grad (H/^f grad a{p))p, (3.4) 

Proof. We recall that for vector fields X,Y, Z, 

2{DxY, Z) = X((r, Z)) + F((X, Z)) - Z((X, Y))+ (3.5) 

([X,F],Z) + ([Z,X],F)-([F,Z],X). 
Note that K{p) = k and K{q) G TqG{q) for g G A^. As a is G-invariant, 

K{a) = {K, grad a) =0. (3.6) 

Moreover, the one-parameter group generated by K consists of global isome- 
trics, thus K is a. Killing vector field, which implies that for any pair of vector 
fields X, F, 

{DyK,X) + {DxK,Y) = 0, or equivalently using (3.5) 

Ki{Y,X)) + {[Y,K],X) + {[X,K],Y) = 0. (3.7) 
We can now compute 

2D^a{X,K) = 2X{K{a)) - 2{DxK){a) = -2{DxK,gTad a) = 

-X{{K, grad a)) - K{{X, grad a)) + grad a((X, K)) 
-([X, ir],grad a) - ([grad a,X],K) + {[K,gmd a],X). 
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From (3.7) we know that 



-K((X,grad a)) - {[X,K],grad a) + {[K,grad a],X) = 0. 

Using (grad a, i^) = 0, we conclude 

2D^a{X,K) = grad a{{X,K))- ([grad a,X],K), 

which proves the first assertion. 

When X = K, the second term above vanishes: using (3.3), 

{[K, grad a],K) = {Oxgrad a,K) - (Dgrad aK, K) 

= {D^grad a, K) + (grad a, D^K) 

= K{{K, grad a)) 

= 0. 



Equation (3.4) follows. 

□ 

Lemma 14. 

2D^a{p){k,b) = grad a{{B,K)){p). 

Proof. By continuity of the formulas in the lemma, we can assume that k ^ 
and that 6, grada(p) are lineary independent. Let Nq be a codimension 
2 submanifold of Ai with p in its interior. Assume that b G T^Nq, k is 
orthogonal to T^Nq, and grad a{p) ^ TpNo. 

Let N = U0t(No) with (pt the flow associated with grad a and where the 
union is taken in a small interval around t = 0. N is a codimension 1 subman- 
ifold. For small e, the integral curve of grad a is thus contained in N, and for 
q = (ptip), we have B{q) = D(j)t{p)b G T^N. Both grad a and B are tangent 
to N by construction. By Frobenius Theorem, [5, grad a] is again tangent 
to N. In particular, [grad a, B]{p) G T^N, and hence ([grad a, B], K){p) = 0. 
From Lemma 13, 

2D^a{B, K) = grad a{{B, K)) - ([grad a, B],K) = grad a((5, K)) 

at p as wanted. □ 
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Proof of Theorem 12. The second covariant derivative is a symmetric bilin- 
ear form. Thus, 

D'^a{p){v,v) = D^a{p){b,b) + D^a{p){k,k) + 2D^a{p){b,k). 

Theorem 12 follows from lemmas 13 and 14. □ 

Corollary 15. Assume that for every p & A4.: 

• D^log(a)(p) is positive semi-definite in {TpG{p))'^ , 

• For h G Tpjvi, h ± TpG{p), we have that D(f)t{p)b ± T^^(^p)G{(f)t{p)) ■ 
Here, (ptil) = 0(^,0') is the flow o/grad a, defined for t G {—e,e) and 
q close enough to p. 

• For every a G the associated vector field K{q) = j-^{exp{ta)q) 
q G M , satisfies 

aD{\\Kf ){gia.d a) + ||irf ||grad af > 0. 
Then, a is self-convex in M.. 

Proof, a is self-convex if and only if log(a) is positive semi-definite. Now, 
let f = 6 + G A^. According to Theorem 12, 

Dl\og{a){p){v,v) = Dl\og{a){p){h,h)+ 

\ (grad^ {{\\K\\^f){p), grad^ log (a) (p) ) «,p + grad^ {{B,K)^){p), 

where K is as defined in Theorem 12 and S is a vector field such that 
B{(j)t{p)) = D(l)t{j))h. Note that grad^a((-B, -ft')^) depends only on the value 
of -B, and K along the integral curve (f)t{p)- Moreover, 

a{Mp)){DMPm,KiMp))) = 0, 
from the second item in the hypotheses of our corollary. Thus, we have 

Dllog{a){p){v,v) = 

Dl\og{a){p){h,h) + ^(grad,((||i^|U)^)(p),grad,log(a)(p))«,,. 
This quantity has to be non-negative for every v or, equivalently, 
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• D^logQ;(p) has to be positive semi-definite in {TpG{p))'^, and 

• (grad^((||i^||«)2)(p),grad^log(a)(p))«,p > for every vector field K, 
K{q) = j-^{exp{ta)q)\\t=o where a e g. 

The second of these two items can be re-written using the original Rieman- 
nian structure (•,•). Note that 

{\\K\lf^a\\K\\\ 
gYa.dMK\\.f) = -grad {a\\Kf) = grad \\K\\^ + \\Kf^^, 
grad^log(Q;) = -grad (logo;) = ^ . 

Thus, 
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(grad ,((||ir|U)2), grad, log(a))« = (grad + 



^ (Q;D(||X||^)(grad a) + ||X|n|grad af) 



The corollary follows. □ 



4 Self-convexity in spaces of matrices 

Let u < n and (k) — {ki, . . . , ky) £ such that ki-\ \-ku — n. We define 

V{k) as the set of matrices A e GL„^^ with distinct singular values 

ai{A) > ■ ■ ■> au{A) > 0, 

ai{A) having the multiplicity ki. Such a matrix has a singular value decom- 
position A = [/Dl^* with [/ e Un, 1/ e U„ and D e GL„,^ with 

D = diag ( oTTTTT^, . . . ,(7„, .r. ,(7„^ I = diag ((7i4i, ■ ■ ■ > ■ 



Above, Vn is the group of unitary n x n matrices. If K = M, it should be 
replaced by the group of orthogonal n x n matrices. 
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We also let 

©(fc) = {D e V(k) ■ D = diag (aJk,,. . . , ajkj , ai > ■ ■ ■ > a^} ■ 

Notice that the singular values ai > ■ ■ • > can vary within each V(^k) 
or each V{k). 

Proposition 16. V(^k) is a real smooth embedded submanifold o/GL„_m- Its 
real codimension is 

• kl + ■■■ + kl-mf K = C. 

• lin + kl + --- + kl)-u z/K = M. 
The tangent space to V(k) (it a matrix 










■■ 


■ ^\ 


D = 








■■ 


■ 




I 


(^uIk 


■■ 


■ V 



is the set of matrices 

/ Ai/fci + Ai * * * . . . *\ 

* ■ . * ^ ■ ■ ■ ^ 

\ * * Kh^ +Au * ■■■ *J 

where Ai, . . . , are skew- symmetric matrices of respective sizes /ui, . . . , ku, 
Ai, . . . , Au G M, and the other entries are complex numbers (real, z/K = Mj. 
Moreover, for any i = 1, . . . ,u, (Ti : V^k) — )■ M is a smooth function. 

Proof. To prove that V^k) is a real smooth embedded submanifold of GL„_m 
we use Lemma 33 (see the appendix). We take G = U„ x Um, M. = GL„^m, 
and V = The group action of G on is given by 

Under this action, the image of is '^(fe), and the equivalence relation 
{U, V, D)n{U\ V\ D') if and only if UDV* = U'D'V* is equivalent to 

D' = D, U' = UM, V' = VMw, 
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where M and Mw are unitary block-diagonal matrices 

M = diag (Ui,...,Uu), Mw = diag (f/i, . . . , f/„, W), 

with f/j G Ufc^, and 1^ G Um-n- Note that the set X(fc) of such pairs (M, Mv^/) 
is the isotropy group of any X G GL„^„. Also, the relation TZ is invariant 
under left I[J„ x Um action, namely: 

{U, V, D)n{U', V, D') ^ {QU, RV, D)n{QU', RV', D') 

for any (Q, i?) G U„ x Um- 

It is easy to sec that the graph of this equivalence relation, that is the 
set of pairs (([/, V, D), {UM, VMw, D)), with U, V, D, M, and W as before, 
is a closed sub manifold in {G x x (G x T>(^k))- Thus the quotient space 

(G X 'Dq;))/TZ is equipped with a unique manifold structure making tt (the 
canonical surjection) a submersion. 

Let us define 

2 : (G X I?(,.))/7^ ^ GL„,^, z(7r([/, V, D)) = UDV*. 

The injectivity of i follows by construction of TZ: elements of {G x I?(^,))/7^ are 
represented non-uniquely by elements {U,V,D) G (G x T>(^k))- Two of those 
elements (say {U, V, D) and {U' , V, D')) represent the same equivalence class 
if and only if UDV* = U'D'V*. 

We still have to check that this map is an immersion. For any (U , V, D) 
in the tangent space T(^u,v,d)G x ©(jt) we have 

D{ioTT)(U, V, D)(U, V, D) = UDV* + UDV* + UDV* = U{AD+D-DB)V* 

with U = UA, V = VB, A and B skew-symmetric matrices of respective size 
n and m. When AD + D — DB = 0, we obtain, via an easy computation, 

i) = 0, A = diag (Ai,...,A„), 5 = diag (A,...,A„,G), 

where Ai and C are skew-symmetric matrices of respective sizes ki and m — n. 
Thus {U, V, b) = {UA, VB, 0) is tangent to the fiber of tt in G x V^^k) above 
7r(C/, V, D) so that Dt:{U, V, D){U, V, D) = 0. In other words 

Di{TT{U, V, D)){D7i{U, V, D){U, V, I))) = =^ Dn{U, V, D){U, V,b) = 

that is Di{T:{U, V, D)) is injective. 
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The last point to check to apply Lemma 33 is the continuity of the inverse 
of i. Suppose that Xp X with Xp,X G Im z = V(k)- We can write 
them Xp = UpDpV* and X = UDV*. Let {Up^, Vp^) be a subsequence which 
converges to (U, V) {G is compact). Since Xp^ — X we have Dp^ — )■ tj*XV = 
D, and UDV* = UDV*. Now we consider the sequence U*XpV. It is a 
convergent sequence, hence it has a unique limit D and {U, V, D)7l{U, V, D). 
Thus, iT{U*Up, V*Vp, Dp) converges to it{I, I, D). By left U„ x f/„ action, we 
conclude that 7r([/p, V^, Dp) converges to 7r([/, V, D) as required. 

Thus, the hypothesis of Lemma 33 is satisfied and V(k) is a real smooth 
embedded submanifold of GL„^m- 

The computation of its dimension is easy: it is given by the difference of 
the dimension of G x ©(^j and the dimension of the fiber above any point in 
the quotient space, that is 

dimU„ + dim Urn + u — dimUfc^ — ... — dimUfc„ — dimI[Jm_„. 

The tangent space ToV^k), D = diag (ai/fci, . . . ,aulku)i is the image of 
the tangent space T(^ir,,im,D)G x V(^k) by the derivative D{i o 7r)(/„, /„, D). It 
is the set of matrices AD + D — DB with D = diag (Ai/fc^, . . . , X^Ik^), A 
and B skew symmetric of sizes n and m. They all have the type described 
in Proposition 16 and this space of matrices has the right dimension. 

Let us prove the smoothness of the map X G V(^k) (^i{X) G M. Since the 
map {U, V,D) G G x — )■ (Ti{D) is smooth, and constant in the equivalence 
classes, the map tt{U,V,D) G (G x ^'(fc))/7^ ai{D) = a,{UDV*) is also 
smooth. Thus the map X = UDV* G V(^k) — > (^{{X) is smooth as the 
composition of the previous map by □ 

Lemma 17. Let I be an open interval. Let {'y{t))tei be a smooth path in 
'P(k)- Then, there are smooth paths U{t) G Vit) G Um and G ^'(fc) 
so that 

7(t) = Um{t)Vit)* (4.1) 

for all t & I . 

Proof. We will show that U(t), V{t) and S(t) are solutions of a certain 
differential equation on the manifold U„ x Vm x 1^{k)- An important fact to 
be used below is that T/U^ is the space of skew-hermitian matrices. In the 
real case, T/0„ is the space of skew-symmetric matrices. Let us assume for 
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a while that (4.1) admits a solution. Differentiating (4.1) with respect to t, 
we obtain after a few trivial manipulations that 

f/(t)*7(t)\/(t) = u{tyu{t)i:{t) - j:{t)v{tyv{t) + t{t). 

For shortness, let M{t) = U{ty^{t)V{t), A{t) = U{t)*U{t) G T/U^ and 
B(t) = V{tyV{t) e TjVm- We have now: 

M{t) = A{t)J:{t) - S(t)5(t) + t{t). 

Using block notation, we obtain for i < j that 

M,,(t) = aj{t)Aij{t) - a,{t)Bij{t). 
The equation for block Mji{t) reads: 

Mji{t) = ai{t)Aji{t) - (7j{t)Bj,{t). 

Transposing, 

M^iity = -(Ti(t)A,,(t) + ajit)Bijit). 

We obtain therefore 



= ^((T,-M,,(t) + aiM,,(t)*) 
Bij = ^{aMj{t) + crjMj,{ty) 



(4.2) 



The blocks in the diagonal (that is, i = j) are of the form 

Mii{t) = Oi^Aii - 5jj) + cTiJfe^, 
hence we can solve by setting 

A,, = -Bu = :^{Mu{t) - &ilkj. (4.3) 
Zai 

Equations (4.2)-(4.3) are a system of smooth non-autonomous ordinary dif- 
ferential equations in variables U G U„, V G Vm and S G T'(fc). The Lipschitz 
condition holds. Hence, for every to G I, there are e > and local solutions 
U{t), V{t) and S(t) for t G (to - e,to + e), solving (4.1). 

In order to show the existence of a global solution on all the interval, 
we need to check that as t — )■ to + the solution converges to a limit in 
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Un X Urn X The convergence of U{t) and V{t) follows from compactness 
of the unitary group. Because 7(to + e) ^ '^{k), 



Hence, the solution {U(t), V{t), can be extended to an interval that is 



Let a : GL„^m be defined by a{A) = an{A)~^. We also denote by a = cr~^ 
its restriction to V(^k) ot to T'(fc). We first consider first the case of diagonal 
matrices, then we prove self-convexity of a in 'P(fc). 

Lemma 18. Let Vi^k) be equipped with the condition metric structure 



1. //El, E2 G I?(A:), then any minimizing condition geodesic in V(k) joining 
Si and S2 lies in T>(^k), 

2. The set ©(fc) is a totally geodesic submanifold of Vi^k) for the condition 
metric, namely, every geodesic in for the induced structure is also 
a geodesic in V(k), or equivalently: 

3. If T, E V^k) (ind S G Tj]V(^k) , th^n the unique geodesic in V(k) through 
S with tangent vector S at S, remains in 

Moreover, a = a^^ is log-convex in T'(fc). 

Proof. According to Proposition 16, V(^k) is a smooth Riemannian manifold 
for the condition structure. 

Let 7(t), < t < T, be a minimizing condition geodesic with endpoints 
Si and S2 G 'D(^k)- Let 7(t) = UtT,tV-i* be a singular value decomposition of 
7(t), choosen as in Lemma 17. Let au{t) be the smallest singular value of 
7(t). It suffices to see that Lk(S) < L^l'-f) that is 



lim S(t) G 



open and closed in J, hence to all /. 



□ 




Since 



7i = UtJ^tv; + ujitv: + f/iSiV;, 
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with Iff = UtAf, Vf = VtBti At and Bt skew-symmetric, we see that 



ml 



\AtT.t + T.t-T.tB^ 



2 

t\\F 



\^t\\F 



\AtT.t-T.tBt\\l > IIS 



t\\F 



because the diagonal terms in Sj are real numbers and those of AtT,t — ^tBt 
are purely imaginary when K = C and vanish when K = M. When does 
not belong to then the inequality above is strict. 

The second assertion is an easy consequence of the first one, The third as- 
sertion is another classical characterization of totally geodesic submanifolds, 
see [20] Chapter 4, Proposition 13 or Theorem 5. 

Finally, for log-convexity of a{X) = using [1] Proposition 3, it 

suffices to see that for S G ©(fc) and E e Tsr'(fc), 



2||S|n|Da„(S)r >DV^(S)(E,S 



(4.4) 



where the second derivative is computed in the Frobenius metric structure. 
Now, 

Thus 

is maximized for the 'unit vector' (in block representation) 







We deduce that 



hence 



\D 



h 



1 



2||E|n|Da„(E)|p 
The right-hand-side of (4.4) is precisely 



2||S||2 



> 2a„(S). 



DV^(S)(S,S) = Z}(2(T4S)a„(S))(S) = 2a„(S) 



and equation (4.4) follows. 



□ 
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Proposition 19. The map a = cr^^ is self-convex in Vi^k)- 

Proof. By unitary invariance, we may choose as initial point a matrix S G 
X'(fc) with ordered distinct diagonal entries ai > ... > (7^ > 0. We use 
Corollary 15, with the group G being I[J„ x Dm and the action 

{{U,V),A) ^ UAV*. 

The Lie algebra of G is the set An x where v4fc is the set of k x k skew- 
symmetric matrices. 

We write G{L) for the G-orbit of a point L G 'P(fc)- In our case, this is 
the manifold of all ULV* with U G U„, V G Vm- The tangent space to the 
Lie group action at L is the tangent manifold T^G^L) C TiP^k)- 

First, we note that for any L G ^^(fc), we have 

{TlG{L))^ = Tl {ULV* : f/ G U„, F G U^}^ = 
{B^L + LBl : G A x . 

Let us denote by S this last set. We claim that S = V(^k)- Indeed, V(^k) ^ S", 
because the diagonal of any matrix of the form B1L+LB2 is purely imaginary 
and hence orthogonal to 'P(fe). The other inclusion is easily checked by a 
dimensional argument: The dimension of 'D(fc) is u and the dimension of S is 

dim(P(fc)) - dim {BiL + LB^ : (Bi, B2) G X x Am} , 

that is dim(P(/;)) minus the dimension of the orbit of L under the action of 
U„ X Um. We have computed these two quantities in Proposition 16, and we 
immediately conclude that dim(S') = n, for both K = C and K = M. Thus, 
for all L G ^^(A:), 

(T^G(L))^ = 
We now check the three conditions of Corollary 15. 

• D^log(a)(S) is positive semi-definite in (TsG'(S))"'": Let 

SG(TsG(S))^ = TsP(fc), 

and let 7 be a condition geodesic in such that 7(0) = S, 7(0) = S. 
We have to check that 

This is true as a is log-convex in T^i^k) from Lemma 18. 
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• We have to check that for small enough t, and for 

t e (rsG(s))^ = rsP(fc), 

D<pt{D)t belongs to 

where (j)t is the flow of grad^a. In our case, 0t can be computed exactly. 
Indeed, 

1 2 

grad^a = — grad a = —- E, 

where 

E = diag (0,...,0,Tr^). 

Thus, grad a preserves the diagonal form, and G Vi^k) is a di- 

agonal matrix, for every t while defined. Thus, Z)0i(E)(E) is again a 
diagonal matrix, for every diagonal matrix S. This proves that the 
second condition of Corollary 15 applies to our case. 

• For (i?i,i?2) G An X Am, the vector field K on GL„_m generated by 
(5i,S2)is 

K{A) = ^ (e*^^Ae*^2) |^^^ = b^A + AB;. 

Note that 

1. K* as a linear operator on GL,n,m satisfies K*{A) = BIA + AB2. 

2. = ||5iS + S52*f, 

3. Forw G TEP(fe), = 2Re {K*K{J:),w) = 2Re(5ifi*S+ 

- 2BiJ:B*,w). 

4. grad a(S) = where E = diag (0, . . . ,0,17^)- 
Thus, 

a(E)D(||i^||2)(E)(grad a(S)) + ||ir(E)f ||grad a(S)||2 = 
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4 



(-a„Re(Ei5*S + J:B2B; - 2BiEB;, E) + ll^iS - SEaf ) . 
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u 



Hence, it suffices to see that J > where 

J = - S^sf - (T«Re(SiS*E + - 2BiI:b;, E). 

Expanding this expression and writing S' = S* — cTuE*, we have 

J = Re (trace + trace (S'S^a^^) - 2trace (^iSE^S')) , 

which by Lemma 20 below is a non-negative quantity. The proposition 



Lemma 20. Let S = diag (cri4i, . . . , cr„_iJfc^_,, cr„4„) G GL„_^ and S' = 
diag {ailkj^, . . . ,au-ilk^_j^,01k^) G GLm„. T/ien, /or any skew- symmetric 
matrices B, C of respective sizes n, m, we have: 



Re (trace (5E*SS') + trace (S'SCC*) - 2 trace (5SC*S')) > 0. 
Proof. We denote 

J = Re (trace (SS*ES') + trace (S'SCC*) - 2 trace (ESC*S')) • 



follows. 



□ 



Write 




and let us write B, C by blocks 




where Ci are of the size of L and -B4, C4 are of the size of Ik^. Then, 



trace (55*SS') 
trace (S'SCC*) 
trace (BSC*E') 



trace {{BiB; + B2B*)L^), 

trace (^^(CiCi* + + C3C3*)) 

trace {BiLClL + a^EsQi:). 
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Thus, 

J > Re (trace + CiCl)L'^ - 25iLC*L)) + 

Re (trace {{B2B; + C2C; + C^Cl)L^ - 2a^B2ClL)) . 

We will prove that these two terms are non-negative. For the first one, note 
that 

Re (trace + CiC*)^^ - 25iLC*L)) = \\BiL - LCif > 0. 

For the second one, we check that for every I, 1 < I < n — k^ the l-th diagonal 
entry of the matrix (-B2-B2 + C2C2 + C3C3 — 2cr„i?2C2L has a positive real 
part. Indeed, if we denote by w e K*^" the l-th row of S2 by w e K^- the l-th 
row of C2 and by x the l-th row of C3, we have 

Re {{B2B; + C2C; + C3C;)L^ - 2auB2C*2L)^ ^ = 

(^f + lkir + Ikf ) -2^Re(t;,w)^ > (rf\\v-wf > 

as au < <yi- This finishes the proof of Lemma 20 and hence of Proposition 
19. □ 



5 Puting pieces together 

Before stating the main result of this section we have to introduce the fol- 
lowing machinery: 

5.1 Second symmetric derivatives 

In the case of Lipschitz-Riemann structures, the mappings we want to con- 
sider are not necessarily and, to study their convexity properties, an 
approach based on the usual covariant second derivative is insufficient. We 
will use instead the second symmetric upper derivative. 

Let f/ C M'^ be an open set and : f/ — )■ M be any function. The second 
symmetric upper derivative of at x G t/ in the direction w e M*^ is 

—2 0(x + /it;) + 0(x - /if ) - 20(x) 
SV (p{x; v) = limsup — 
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which is allowed to be ±00. If f/ C M is an interval, we simply write SV'^cjy^x) 
for 

It is well-known that a continuous function on an interval is convex if 
and only if iSP^0(a;) > for all x (see for example [27] Theorem 5.29). There 
is a stronger result due to Burkill [ ] Theorem 1.1 (see also [27] Corollary 
5.31) which uses a weaker hypothesis: 

Theorem 21 (Burkill). Let cf) :]a,6[— he a continuous function such that 
S'D^(f){x) > for almost all x E]a,b[, and assume that S'D^(f){x) > —00 for 
X E]a,b[. Then, (p is a convex function. 

Theorem 21 will allow us to assemble the pieces where convexity is proven 
in Proposition 19 to prove our main results (Theorems 1 and 31). We proceed 
a little more generally as the result may be of interest in other circumstances. 
Let be a /c-dimensional manifold (not necessarily having a Riemannian 
structure). 

Definition 22. Let a : — )■ M. We say that SV^a is bounded from —00 

(denoted SV^a > —00) if for every x E Ai there is an open neighborhood 
Ux ^ -M. and a coordinate chart ip^ '■ — )■ M*^, ipx{x) = such that 

SV'^{aoif-^){0-v) > -00 

for every v eM.^. 

The following lemma is a consequence of Definition 22. 

Lemma 23. Let Ai be a C"^ manifold, let a : Ai — i']0, oo[ be a locally 
Lipschitz mapping. Then, SV^a > —00 if and only if, for any function 
(j) :]0,oo[— 7- M of class C"^ , ST>'^{(j)oa) > —00. In particular, SV^a > —00 if 
and only if SV'^ {log oa) > —00. 

Proof. The i/part is trivial (just make (j){t) = t). In order to prove the only 
if part, we assume that SV^a > —00. Let x E Ai and let ip^ '■ ^ M*^ be 
a coordinate chart such that (p>x{x) = and SV^^a o Lp~^)(0]v) > —00 for 
each f G M'^. There is a sequence hp ^ such that 

a{^-\hpv)) + a{if-\-hpv)) - 2a{x) ^ ^ ^ _^ 
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Let us define Hp = a{(p^^{hpv)) — a{x), and similarly Kp — a{(p^^{—hpv)) 
a{x). By Taylor's formula we get 

(P{a{ip-\hpv))) = (P{a{x)) + (P'{a{x))Hp + (P"{a{x))^ + o{H'p), 
and similarly 

(t>{a{^-\-hpv))) = 4>{a{x)) + 4>\a{x))Kp + (t>"{a{x))^ + o{Kl), 
so that 

(i){a{ip-^{hpv))) + (t){a{ip-^{-hpv))) - 2(p{a{x) 



hi 

Notice that limp_>.oo ^^t^^'^ = C. Since h — )■ a{ip~^{hv)) is Lipschitz in a 

rip 

neighborhood of we have, for a suitable constant D > 0, Hp < Dhp and 

Kp < Dhp. Thus, taking the limsup as p ^ oo gives SV^cp^a o (^~^)(0, > 
C + D > — oo and we are done. □ 



5.2 Projecting geodesies on submanifolds : the Eu- 
clidean case 

The following technical lemma, interesting by itself, is a consequence of 
Lebesgue's Density Theorem. 

Lemma 24. For any locally integrable function f defined in M with values 
in M."- , let X E M. be a point where f is locally integrable. This means that 
F'{x) = f{x) where F denotes an antiderivative of f. Then 

"X+e 



2 rx+s 

lim^ / (y-x)f{y)dy^f(x). 



Proof. Notice that, by Lebesgue's differentiation theorem, an antiderivative 
F of / exists a. e. and it is absolutly continuous. Suppose that F[x) = 0. 
Let us define 

F{y)/{y -x) iiy^x, 

f{x) if y = a;, 



h{y) 
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so that h is a continuous function and F{y) = {y — x)h{y) for any y. Inte- 
grating by parts gives 

he fx+e 

(y - x)f{y)dy = eF{x + e)- l F{y)dy 



so that 



/ (y - x)f{y)dy = 2^ ^ - - / {y - x)h{y)dy. 



Since h is continuous, by the Mean Value Theorem, there exists C, & [x,x + e\ 
such that 

{y - x)h{y)dy = — — / {y - x)dy = h{C) -> h{x) = f{x) 



as e — ?► 0. On the other hand 



Thus 

lim {y- x)f{y)dy = 2f{x) - f{x) = f{x) 

and we are done. □ 

Our aim is now to see how close are a geodesic in a Lipschitz-Riemannian 
manifold and a geodesic in a submanifold when they have the same tangent 
at a given point. Let us start to study a simple case. 

Let us consider the Lipschitz-Riemann structure defined on an open, k- 
dimensional set C M'^ containing by the scalar product {u, v)^ = v^H{x)u 
(see section 2.3). 

1. The matrix H{0) is supposed to have the following block structure 

We also suppose that (see section 2.3) 

2. The entries hij{x) of H{x) are regular at x = 0, 
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The set Qp = Q n (M^ x {0}) is a submanifold in fl. We suppose that 

3. Hp is in Qp, 

so that Qp is in fact a smooth Riemannian manifold for the induced 
if— structure. Let us now consider a vector a G M^x {0} and three parametrized 
curves denoted by x, Xp, and y defined in a neighborhood of in M, and such 
that: 

4. x(0) = Xp{0) = y{0) = 0, 

5. x(0) = Xp{0) = y{0) = a, 

6. a; is a geodesic in M.'^ for the iJ-structure, 

7. Xp is its orthogonal projection onto W x {0}, 

8. y is a geodesic in MP x {0} for the induced structure. 

According to Theorem 3, x has regularity (7^+-^*p so that its second derivative 
exists a.e. We suppose here that 

9. The second derivative x{t) is defined at t = 0, and 

d 



dt ^"^-^^^^-^^^^ - 2 
In this context we have: 

Lemma 25. Under the hypotheses 1 to 9 above, the curves Xp and y have a 
contact of order 2 at 0: Xp{s) = y{s) + o(s^). 

Proof. By hypothesis 3, 

y G C (5.1) 

Hypothesis 8 says that y is a geodesic. Because geodesies are parametrized 
by arc length, 

f{s)Hp{y{s))y{s) = 1. (5.2) 
The Euler-Lagrange equation for geodesies in is now 

^{Hp{y{s))y{s)) = ^^yi{s)yj{s)gmd hp,,j{y{s)), (5.3) 
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iH{x{t))x{t)) G ^5^Xi(0)x,(0)9/i,,(x(0)). 



where hp^ij is /ijj, seen as a function of Xi, . . . , Xp. The differential system (5.1- 
5.3) actually defines y{s) as a curve in fip, in function of the initial condition 

(z/(o),?/(o)). 

Moreover, thanks to hypothesis 9 we have: 

d 1 ^ 

iy(x(0))x(0) + — (if(x(t)))x(0) G - ^ i;i(0)xj(0)5/iij(x(0)). 

2,J = 1 



When we project it onto W we get, with x{t) 



Xp(t) 



d 1 ^ 

Hp{0)xp{0) + - {Hp{xp{t)))xp{0) e - V Xp,,(0)xpj(0)nMp9/ii,(x(0)). 
ar|t=o i 

Since the functions hij{x) for z,j = 1. . .p are regular (hypothesis 2), from 
Clarke [10] Proposition 2.3.15, we obtain 

ll]^pdhij{x{0)) = dhp^ij{xp{0)) = grad hp^ij{xp{0)) 

so that 

d 1 ^ 

Hp{0)xp{0) + — \t=o {Hp{xp{t)))xp{0) = 2 Xp,i(0)xpj(0)grad hp^ij{xp{0)), 

Taking at t = the differential equation giving y and noting that y{0) = 
Xp(0), y{0) = Xp{0) gives 

y{0)=Xp{0). 

We want to prove that Xp{s) = y{s) + o{s'^). According to Taylor's formula 
with integral remainder, we have 



Xp{s) - y{s) = Xp{0) - y{0) + s{xp{0) - y{0)) + / {xp{a) - y{a))ada, 

Jo 

so that, 

^xJs) — y(s) 2 /■*,.. , , ... , 
2 ^ = - / (xpia) ~ yia))ada. 

From Lemma 24 and hypothesis 9, the limit of this expression exists at s = 0, 
and it is equal to Xp(0) — y{0) = 0. This achieves the proof. □ 
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Proposition 26. Let M'^ be endowed with the Lipschitz-Riemann structure 
defined by {u,v)x = v^H{x)u, where the entries hij{x) of H{x) are regular 
and H{x) has the block structure 



for X eR''. Assume that Hp is for all x eW x{0} cR''. Let x : [a, b] 
R'^ be a geodesic in with respect to the Lipschitz-Riemann structure. Then, 
there exists a zero-measure set Z C [a, b] such that for ^ b]\ Z the 
following holds: 

"Ifx{to) G MP X {0} C R^ and x{to) eR^x {0} C M^ then the projection 
Xp{t) = 7iK.p{x{t)) has a contact of order 2 with y{t), the unique geodesic in 
R^ with respect to the Lipschitz-Riemann structure Hp with initial conditions 
y{to) = x{to) and y{to) = x{to) ". 

Proof. From Remark 6, there exists a zero measure Z C [a, b] such that for 
to G [a, b] \ Z, x(to) exists and 



From Lemma 25, for every such to, if in addition x{to) G M*' x {0} and 
x{to) G X {0}, then Xp{t) has a contact of order 2 with y{t) and we are 



5.3 Projecting geodesies on submanifolds : the Rie- 
mannian case 

Our aim, in this section, is to prove another version of Lemma 25 in a different 
geometric context. Let be a Riemannian manifold with distance d, of 
dimension k, and let N' he a submanifold of dimension p. 

Let us first define the projection onto (Fig.l). To each q E M and 
to a vector u 7^ normal to A/" at g we associate the geodesic 7g,„ in M. such 
that 7g,«(0) = q and 7g,«(0) = u. Let n E M he given, and let U he an open 
neighborhood of n such that, for each m eU there exists a unique geodesic 
arc 7ij,u(t), t in an open interval containing 0, contained in U and containing 
m. Thus U is the union of such geodesic arcs and two of them have always 
a void intersection. This picture defines a map K : U ^ M hy K{m) = q 





done. 



□ 
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Figure 1: The projection K : M. ^ M . 

if m = 7q,„(t). The map K is the projection map onto M . It has the 
following classical properties: 

1. It is defined in the neighborhood U oi n E Af, 

2. For each m E U, K{m) is the unique point in A4 such that 



inf d(m,q) = d(m, K(m)) 



3. K is C\ 

See Li-Nirenberg [18] or Beltran-Dedieu-Malajovich-Shub [']. 

Let a : M. — )-]0, oo[ be a locally Lipschitz, regular map (see section 2.3). 
It defines a conformal Lipschitz-Riemann structure on Ai associated with 
the inner product 

We call it the a— structure. We suppose that a is when it is restricted to 
so that is and not only Lipschitz for the induced a— structure. 

Proposition 27. Under the hypotheses above, let 'y : [a,b] ^ M. be a 
geodesic curve in Ai for the a— structure. Then, there exists a zero-measure 
set Z C [a, b] such that for to G [a, b] \ Z the following holds: 
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"//7(to) ^ o-'i^d 7(to) ^ T^ito)-^) then the projection •y^fit) = {K o'y)(t) 
of 7 onto J\f has a contact of order 2 with 6{t), the unique geodesic in Af 
such that S{to) = 7(^0) o,nd S{to) = 7(^0) "■ 

Remark 28. If M, Af and a are assumed to be smooth then Z = in 
Proposition 27. See for example the proof of Proposition 5.9 in [29]. 

Proof. The proof consists in a transfer from Ai to M'^ where we apply Propo- 
sition 27. Let 

Z={toe [a, b] : 7(to) G Af, 7(^0) G T.^to)^ but lim ^"^f ^ 7 ^ 7^ ol . 

We have to check that Z is a zero measure set. It suffices to see that for 
every t £ (a, b) there is an open interval I containing t and such that I D Z 
has zero measure. Without loose of generality, we may assume that t = 0. 
Thus, let if: = G (a, b) and let n = 7(0). 

Since AA is C^, the normal bundle to Af is and there exists a 
diffeomorphism : f/ — )■ F C M^, where \^ is an open set containing 0, 
satisfying 

1. = 0, 

2. (j){un^) = vr\{Wx {0}), 

3. For any q & Af and any vector u ^ normal to Af aX q, (p {lq,u) is a 
straight line in orthogonal to x {0}. 

We make an isometry in defining on V C M'^ a Lipschitz-Riemannian 
structure by 

(L)0(m)u,D0(m)t;)^(^) = a(m) 

for any m E U, and u,v E T^AA. Let us denote a; = (p{rn), a = D(f){m)u, 
b = D(j){m)v, we also write this scalar product 

(a, b)^ = b^H{x)a 

where if is a locally Lipschitz map from V into the k x k positive definite 
matrices. 

Notice that H is regular because a is regular in J\f. 
Since for every h E Af HU, 



D(f){n) {Tf,Af) = W X {0} and D<f{n) ({Tf,Af)^) = {0} x 



nk-p 
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H{x) has the block structure 




Hp{x) 
Hk-pix) 



) 



Since a is when restricted to A/" we have the same regularity for the 
restriction of if to x {0}. 

Since is an isometry the curves o 7 and (po S are geodesies in M.^ and 
W X {0} respectively, and, from the definition of (p, the orthogonal projection 
(in the Euclidean meaning) of o 7 onto W x {0} is equal to o 7_^. 

Thus, the hypotheses of Proposition 26 are satisfied so that o ■jj^ and 
(j) o S have an order 2 contact at every t out of a zero measure set Zq. This 
gives easily an order 2 contact for 'jj^f and S at t ^ Zq in Ai in terms of the 
a— distance but also, since 1/a is locally Lipschitz, in terms of the initial 
Riemannian distance. The proposition follows. □ 

5.4 Arriving to the main theorem 

We are now ready to state the main theorem in this section: 

Theorem 29 (Piecing together). Ai = W^iAii is a Riemannian man- 
ifold, enumerable union of the suhmanifolds Aii. Let a : A4 — ;']0,oo[ be a 
locally Lipschitz mapping. Assume that: 

1. a is regular, 

2. For each i, the restriction of a to Aii is and self-convex in Aii, 

3. SV^a > -00. 

Then, a is self-convex in M.. 

Proof. Once again we add to Ai the a— structure. If this theorem is false, 
there exists a geodesic 7 in for the a— structure such that 



on a positive measure set P C M (Theorem 21 and Lemma 23). Since an 
enumerable union of zero- measure sets is also a zero- measure set, we can 
suppose that P C A^i for some i, so that 7(t) G M.i for every t & P. 
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According to the Lebesgue Density Theorem, almost all points t E P are 
density points, that is 

meas iP n \t — e A + e\) 
lim — = 1. 

e->o 2e 

We remove the "non-density points" from P to obtain a new set, also called 
P, with positive measure and only density points. Since 7 G (Theorem 
3), the second derivative j{t) exists for almost all t. We also remove from P 
the zero measure set of Proposition 27. 

Let t G P be given. Since it is a density point of P, we have s G P for "a 
lot of points" close to t. Since 7(5) G Aii for such points, and since 7 is C\ 
we get 

7(t) G r^(t)7Wi. 

Take now the geodesic S in A^j for the induced a— structure such that S(t) = 
7(t) and S{t) = 7(t). As we have removed the zero-measure set of Proposition 
27, 7j and 6 have a contact of order 2 at t. 

By self- convexity of a in J\4i, and since 6 is we get 
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5© ^ log oa o = — log oa o 6{t) > 0. 



Let us now consider 



2 , log oa o 7(t + /i) + log oa o ^(t — h) — 2 log oa o 7(t) 



It is not difficult to prove that t is a density point of 

Q = {s = t + heP : t-heP}. 

Let us denote by 7i the projection of 7 on Aii (see section 5.3). For the 
points s = t + h G Q, one has ■y(t + h) = ■jiit + h), jit — h) = ■jiit — h), and 
7(t) = 7i(t), thus 

2., s _ log og o jiit + h) + log og o 7^(t - h) - 2 log oa o 7i(t) 

From the contact of order 2 between 7j and 5 we then conclude, 

2/, \ logoa o 6(t + h) + logoa o 6(t — h) — 21ogoQ; o 5{t) + oiji^) 
A \n) = 



/l2 
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Since (5 is C^, taking the limit as /i — )■ gives 

limA2(/i) = — \ogoao5{t). 
Since this last expression is nonegative we obtain 



5PMog(a(7(t))) > \imA\h) > 



which contradicts our hypothesis SV^ \og{a{-f{t))) < on P. □ 

6 Proof of Theorem 1 

Theorem 1 is a consequence of Theorem 29 applied to = GL„_m considered 
as the union of the submanifolds V(k) (see section 4) and to the mapping 
a{A) = aniA)'"^, the inverse of the square of the smallest singular value of 
A G GL,n,m- According to propositions 16 and 19 we just have to prove 
that a is a regular map and that SV^a > — oo. Let us start with this last 
inequality. 

We must prove that for every A E Ghn^m, B E K"^™, 

^nHAH) + a-\A^,)-2a-'{A) 



SV'a~'{A; B) = limsup " ^ " > -cx), 



where Ah = A + hB. Now, let be the set of symmetric, positive definite 
n X n matrices. Then, 

a-'{Ah) + a-'{A.h) = Xn^AhAl) + A;i(A_,A*_ J. 

where, denotes the smallest eigenvalue. Since, for any S E Sl^, 

XniS) = inf u^Su, 

ueR", \\u\\=i 

it is a concave function of S, and A,^^ is convex. Thus, 

K\AhAl)+X-\A.hA\) > (^^h^A±Azh^^ = 2X~\AA*+eBB*). 



We conclude that 



2X-\AA* + K^BB*) - 2X-^{AA* 



5) > limsup ,2 
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This last quantity is bounded in absolute value for is locally Lipscliitz, 

so m particular SV^a'^^A; B) > — oo. 

To prove that a is regular it suffices to write it as the composition of 
maps and of the convex which is also a regular map (see [iu] Prop. 

2.3.6). This finishes the proof of our Main Theorem 1. 

7 The solution variety 

As in [ ], we are also interested in the log-convexity of cr„(A)~^ in the solution 
variety: 

W = {iA,x) e Ghn,n+1 X P(K"+^) : Ax = 0}. 

Remark 30. In [ ] we have sometimes taken A to lie in the unit sphere of 
j^nxm even the projective space P(K"^™'). The interested reader can check 
[i] for the relations between self-convexity in the various settings. 

Theorem 31. For any condition geodesic t {A(t),x{t)) in W, the map 
t — )■ log ((T~^(A(t))) is convex. 

As we have done in the case of Ghn,m, we divide the proof in several 
sections. 

7.1 The smooth part of W 

Let u <n and {k) = {ki, . . . , G N" such that ki + ■ ■ ■ + ku = n. We define 
W^k) = {iA,x)eW:AeV^k)}. 

Proposition 32. For any choice of {k), the set VV(fc) is a smooth submanifold 
ofW, Ou is a smooth function and a = cr~^ is self-convex in W(fc). 

Proof. Let us consider the map 

: P(fe) X K"+i \ {0} -> K" 
{A,x) Ax 

which is a smooth mapping between two smooth manifolds. Since is a 
regular value of ip, its preimage iIj~^{0) is a smooth submanifold of V(^k) x 
K""*"^ \ {0}- Moreover, au is the composition of the projection onto the ffist 
coordinate W(fe) — )■ V(k) and the function au which is smooth by Proposition 
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16. To check that au is self-convex in W(fc) we use Corollary 15 and proceed 
as in the proof of Proposition 19. Let G = U„ x Vn+i, and consider the 
action 

G X ^ 
{{U,V),{A,x)) ^ {UAV*,Vx) 

Let p = (S, e„+i) where e^_,_]^ = (0, . . . , 0, 1) and S G 'D(fc) has ordered distinct 
singular values ai > ■ ■ ■ > cr„ > 0. Recall that TpG{p) is the tangent space 
in p of the orbit G{p) of p by the Lie group G. As in Propositions 16 and 19, 
we have 

TpG{p) = {(BiS + SB*,52e„+i) : {B^.B^) E An x A+i}, 

TpG{p)^ = {(S,0) : S G P(fc), S is diagonal, Se„+i = 0}. 

Note that TpG{p)^ is isometric to the set of diagonal n x n matrices with 
eigenvalues cxi >...>(!„> of respective multiplicities ki, . . . ,ku. 

Let us check the conditions of Corollary 15. By unitary invariance, we 
can choose a pair p = (E, Cn+i) as above. 

1. Dl\og{a){p) is positive semi-definite in {TpG{p))^: Let (S,0) G TpG(p)-'-. 
Let 7 be a condition geodesic in TpG{p)^ such that 7(0) = (S,0), 7(0) = 
(E,0). We have to check that 

^log«(7W) lt=o>0. 

This is true as a is log-convex in the set of diagonal n x n matrices with 
eigenvalues ai > . . . > > from Proposition 16. 

2. We have to check that for small enough t, and for 

b = {t,0)eTpG{p)^, 
D(f)t{p)b is perpendicular to 

where (pt is the flow of grad^a in >V(fc). Now, as in the proof of Proposition 19, 
the operator grad preserves the diagonal form of (E, e„) and hence D(j)t{p)b 
is of the form (S',0) where S' is diagonal with S'e„ = 0. In particular, it 
is orthogonal to T0^(p)G'(0f(p)). Thus, the second condition of Corollary 15 
applies to our case. 
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3. For {Bi, B2) G ^„ X Am, the vector field K on W(fc) generated by (i?i, B2) 
is 

K{A,x) = ^ {e'^'Ae'^*\e*^^x) \^^^ = {B^A + AB;, B2X). 
Note that 

\\K{A,x)f = \\B^A + AB^f + \\B2xf. 

Thus, 

D{\\Kf){A,x){C,v) = j^\t=o {\\K{A + tC,x + tv)r) = 
2Re{BiBlA + AB2B; + 2BIAB;, C) + 2Re(5;52X, v). 

Moreover, 

grad a(S,e„+i) = ( --^E,0 ) where E = diag (0, . . . ,0,17"^^). 
Thus, 

e„+i)L'(||irf e„+i)(grad e„+i)) + ||ir(S, e„+i)f ||grad e^+i] 
(-a„Re(SiS*E + S^a^^ - 2BJ:BI E) + - S^af + H^so^f ) . 

This is positive from the proof of Proposition 19. 

Hence, all the conditions of Corollary 15 are fulfilled and the Proposition 
follows. □ 



7.2 Proof of Theorem 31 

Now we can prove Theorem 31 using Theorem 29 and Proposition 32. Note 
that we have W = U(fc)W(fc) and a is smooth and self-convex in each W(fc) 
by Proposition 32. From Theorem 29 we just need to check that a is regular 
in W and that SV^a > —00. Since 

a = 0-^-2 o TTi, 

where tti is the projection on the first coordinate, a is a smooth function. 
Now, consider the chart locally given by vrjf ^, and note that a o ttj^^ = is 
regular in Ghn,m from the proof of Theorem 1. By definition, this means that 
a is regular in W(fc). Using the same argument, SV'^a~'^ > —00 in GL„,„ 
also implies that SV^a > —00 in W and we are done. □ 
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8 Appendix 



In this appendix we prove the following which gives a sufficient condition for 
the image of a submanifold under a group action to be a submanifold. 

Lemma 33. Let G he a Lie group acting on a smooth manifold M., and 
T> a smooth submanifold in M.. Define on G x V the equivalence relation 
{g , d)TZ{g' , d') when gd — g'd' . Let us denote by 

n-.GxV^ (GxV)/n 

the canonical surjection onto the quotient space, by i the map 

i:{GxV)/n^M, i{n{g,d)) ^ gd, 

and byV — i{{GxT>)/TZ) the image ofi. When the three following conditions 
are satisfied 

1. The graph ofTZisa closed submanifold in {G xT>) x [G x V), 

2. i is an immersion, 

3. For every sequence (xk) G (G x V)/7l such that {i{xk)) converges to 
y &V the sequence {xk) converges, 

then, V is an embedded submanifold in M. . 

Proof. Let A' be a manifold and let TZ denote an equivalence relation defined 
on A'. A classical necessary and sufficient condition to define on the quo- 
tient space X /TZ a unique quotient manifold structure making the canonical 
surjection tt : A" — > X /TZ a submersion is the following: the graph Q of the 
relation is a closed submanifold in X xX and the first projection pri : Q ^ X 
is a submersion. 

In the context of our lemma this condition comes from the first hypothesis 
and from the definition of the equivalence relation via the group action. 

Let / : 3^ — > Z be a smooth map between two manifolds. Its image f{y) 
is a submanifold in Z when / is an immersion and a homeomorphism onto 
its image. 

By construction, i is smooth. It is a homeomorphism by the third hy- 
pothesis and an immersion by the second one. To check that it is injective, 
we have to show that if gd — g'd' , then [g, d)TZ{g' , d'). This follows from the 
construction of the relation TZ. 

□ 
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